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Let M be a connected ra-dimensional complex projective manifold and 
consider an Hermitian ample holomorphic line bundle (L, /i^,) on M. Sup- 
pose that the unique compatible covariant derivative Vl on L has curvature 
—2712^2, where f2 is a Kahler form. Let G be a compact connected Lie group 
and /i : G X M — > M a holomorphic Hamiltonian action on (M, Vt). Let g be 
the Lie algebra of G, and denote by $ : M — g* the moment map. 

Let us also assume that the action of G on M linearizes to a holomorphic 
action on L; given that the action is Hamiltonian, the obstruction for this is 
of topological nature |GSlj . We may then also assume that the Hermitian 
structure Hl of L, and consequently the connection as well, are G-invariant. 
Therefore for every fc e N there is an induced linear representation of G on the 
space H^{M, L®^) of global holomorphic sections of L®^ . This representation 
is unitary with respect to the natural Hermitian structure of H^{M, L®^) 
(associated to Vt and /il in the standard manner). We may thus decompose 
H^{M,L®^) equivariantly according to the irreducible representations of G. 

The subject of this paper is the local and global asymptotic behaviour of 
certain linear series defined in terms this decomposition. Namely, we shall 
first consider the asymptotic behaviour a.s k —>■ +00 of the linear subseries of 
H'^{M, L®^) associated to a single irreducible representation, and then of the 
linear subseries associated to a whole ladder of irreducible representations. 
To this end, we shall estimate the asymptoptic growth, in an appropriate 
local sense, of these linear series on some loci in M defined in terms of the 
moment map 

To express the problem in point more precisely, fix a Cartan subalgebra 
f) C 0, and let C G be the corresponding Cartan subgroup. Let i? C f)* be 
the root system for (g, f)), and fix a basis S = {ttj} C R for R. Let X{H) be 
the group of characters of H, identified with a subgroup of f)* (a character 
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X : if — >■ C* is determined by its differential at the identity). The finite 
dimensional irreducible representations of G correspond bijectively to points 
in X{H) n where C f)* is the positive Weyl chamber jB]. Let be 
the irreducible representation associated to u E X{H) fl \)\. We have for 
every > a G-equivariant orthogonal decomposition 

H\M,L®^)= H^M^L"^^)^, (1) 

where each H^{M, L®^)^^ is equivariantly isomorphic to a direct sum of copies 
of Et_j. We shall first focus on the asymptotic behaviour, as ^ +oo, of 
the linear series \H'^{M^L®^)^^\ for a fixed uj E X(H) fl f)^, under certain 
transversality assumptions on the moment map $. 

Let us now clarify what is meant here by local asymptotic behaviour of 
a family of linear series such as \H^{M, L'^^)^^ Suppose first that V C 
H^{M^L) is any nonzero vector subspace, and let {sj} be an orthonormal 
basis of V for the induced unitary structure. Consider the function 

where || ||p denotes the Hermitian norm of L at p. This is in fact independent 
of the choice of orthonormal basis, as one can see by replacing the s^-'s by 
tk = '^jUjkSj where U = [uij] G U{dim{V)) is a unitary matrix, and then 
working in a local frame. By the same reason, given that the representation 
of G on H^{M, L) is unitary, if \^ C H^[M, L) is G-invariant then so is the 
function uy. Here we shall be interested in sequences of functions such as 
^H"{M,L'sk)^ and in their asymptotic behaviour. 

Pictorially, we may think of I'vip) as measuring the local size, under the 
chosen metric structures, of V at p. Asymptotic expansions such as (jHI) below 
have attracted interest in algebraic geometry since Zelditch remarked that 
they control the metric (equivalently, symplectic) asymptotic behaviour of 
the maps to projective space associated to the linear series at hand [Z]. 

Theorem 1. Suppose that E Q* is a regular value of the moment map 
$ : M ^ 0* and that G acts freely on $"^(0). Set n = dimc(M), g = 
dim^{G). There exist on <I>~"^(0) smooth G-invariant real valued functions 
Oo > and, for every u E X{H) fl f)^ and I > 1, a|'^'* with the following 
property: Suppose given uj E X{H)nl)^ and the assignment, for every k eN, 

of an orthonormal basis I s^.^''^-' I of H^{M, L®^)^^. Then there is for k ^ 
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an asymptotic development, uniform in p E ^ ""^(0); 

5^ ||sf'"Hp)|f ~ k^-'" dim(VL)^ao(p) (2) 

j 

+ Y,k^-'-3'^af'\p). 
i>i 

Here denotes the irreducible representation associated to uj. 

If G denotes the complexification of G, the actions of G on M and L 
extend to holomorphic actions of G. Given any subset A C M, we shall 
denote hj G ■ A its saturation under G, that is, 



G ■ A = l^g-m: g eG,m e m| . 



In the hypothesis of the Theorem, G acts freely on G • $ ^(0), and the latter 
is the open subset of stable points for the action of G on M |GSlj . 

Corollary 1. Under the hypothesis of Theorem^ there exists such that 
for k > the base locus of the linear series \H'^(M, L^'^)^^ satisfies 

Bs(|i/°(M,L®'^)^|) C M \ (g- $-^(0) 



Away from $ ^(0), X],- 



s- ' '{p) 



is rapidly decreasing in k, uniformly 



so on the complement of the unstable locus. More precisely, let i? = M \ 
G ■ $^^(0) ) be the set of unstable points of the action. Then, 



Proposition 1. In the situation of Theorem^ if p ^ ^ ^(0) then 



(p) =0{k'''), N=l,2 



This estimate is uniform on compact subsets of M \ ($ ^(0) U R) . 

Let us at least briefly describe how Theorem^generalizes when the action 
of G on $~^(0) is not free. Since is a regular value, the action of G on 
$~^(0) is at any rate locally free, and therefore the stabilizer subgroup Gp 
of any p G $~^(0) is finite. Furthermore, there is an induced unitary action 
ap : Gp ^ on the Hermitian complex line {Lp, hp). We may then take the 
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L^-product of ttp and Xuj on Gp with respect to the counting measure, that 
is, 

(Xa;,ap)Gp = xM ■ Oip{g). 

g&Gp 

Then is replaced by 

J2 \\4'^\p)\f - k--''' dim(K.) (X., «J)g, ao(p) + A;"-'-^/2a;-)(p), 

uniformly in p G $~^(0). 

The microlocal techniques used in the proof of Theorem^can also be used 
to study the asymptotic growth of the dimension of the spaces of equivariant 
sections H^{M,L®'')^ when u is kept fixed and A; ^ +00. There already 
exist two approaches to this problem, one geometric and the other algebraic. 

A geometric solution follows from Meinrenken's proof of a fundamental 
conjecture of Guillemin and Sternberg [M], resting on the symplectic cutting 
technique of E. Lerman [L]: Obviously G acts on every cohomology group 
Wi^M, L), i = 0, . . . ,n, and we may consider the virtual vector space 

n 

RR(M,L)^ = J](-l)^i7^(M,L)^. 

1=0 

Let fiuj = fi:^{M,L) be the corresponding virtual multiplicity for the re- 
presentation Kj. By the main Theorem of fMj, fi^ may be computed as a 
Riemann-Roch number on the symplectic reduction of the Hamiltonian 
G-manifold (M, Q, $) at 00, provided is a regular value of the moment map. 
Then = ^~^{uj)/G^, where G^ C G is the stabilizer subgroup of u under 
the coadjoint action. Assuming to fix ideas that Gf acts freely on $^^(co'), 
naturally inherits by restriction and quotient a Kahler structure and a 
compatible polarization L^. Then by Theorem 1.1 and Corollary 1.2 of [M] 

fi^ = RR(M^,L^). 



Let us now replace L by L® , and thus Q by kQ and $ by $fc = By 
Serre vanishing if ^ then H'^{M^L®^) = for all i > 0, and there- 
fore RR{M,L^% = H°{M,L®'')^ and is the multiphcity of in 
H^{M,L®^). Thus, 

dim i^°(M, = dim(K,) ■ RR(M^,fc, L^), 

where M^^k = ^'^ik~^^^)/G^ is the reduction of {M,kil,^k) at u and L®^ 
is the polarization on it induced by L®*^. Now by Corollary 7.3 of jM] the 
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reduced spaces iW^ ^ are all diffeomorpliic to the fibration 

M(P,a) = PxGa, 

where P = <l>~^(0) is viewed as a principal G-bundle over the symplectic 
quotient Mq = $~^(0)/G, and Ouj is the coadjoint orbit of u. On the other 
hand, again by Corollary 7.3 of [M], the symplectic structure Q^^^k on M^^k is 
the one induced by minimal coupling |GS3j from kfl, the symplectic structure 
cTk-iuj on a fixed connection on P and the moment map J^^k = \Juj '■ 

^ g* of Ouj,k- With the appropriate scaling taken into account, one 
obtains a leading asymptotics of degree n — g. 

There is also an algebraic line of research on this asymptotic problem, in 
the work of Brion and Dixmier [BD] , ^ . 

Here we propose a different, analytic and fairly elementary approach to 
the same asymptotics: namely, we use Boutet de Monvel and Sjostrand's 
microlocal description of the Szego kernel [BR] to reduce the problem to 
an application of the stationary phase Lemma along $~^(0). Behind some 
technicalities, the basic idea is very simple. 

In this formulation, the asymptotics depends on the weight uj only through 
the germ at the identity e G G of its charachter function Xuj G C°°{G), rather 
than on the geometry of the coadjoint orbit (9^. 

Theorem 2. In the hypothesis and notation of TheoremUl there exist for 
J > 1 differential polynomials Sj of degree 2j on a neighbourhood of e E G 
such that for any uj e X{H) fl f)^ we have 

dim H\M, L®^)^ ~ dim(K.)2 ■ vol(Mo) • P"^ (3) 

+ dim(K;) 5Z&,>A;"-3-^ 

where vol(Mo) is the volume of the reduced space Mq =: ^^^{0)/G with its 
natural Kdhler structure, and bj^^ = S'j(xw)(e). 

It follows from the proof of Theorem |21 (and the stationary phase Lemma) 
that the S'j's may be expressed in terms of the Hessian of along $^^(0) 
and the classical symbol appearing in the Fourier integral representation of 
the Szego kernel of H given in |BSj . 

This extends to our setting a (special case of a) result of Brion and 
Dixmier jBD], [B]: 

Corollary 2. In the hypothesis of Theorem^ let fi^^ ^ be the multiplicity of 
m E^{M,L®^)^. Then 

lim = dim(K;). 
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When ^ $(M), a more informative result is provided by the study of 
the corresponding asymptotic properties of the ladder hnear series 

oo 

i=\ 

We shall now assume that G is semisimple. 

The action of G on L induces an action on the dual line bundle L*, 
equipped with the dual hermitian metric. The unit circle bundle X C L* is 
invariant under G, and therefore there is an induced Hamiltonian action of 
G on the cotangent bundle T*X, and on the complement of the zero section 
r*X \ {0}. Let \I' : T*X \ {0} 0* be the corresponding (conic) moment 
map. 

Since the connection is G-invariant, the action on T*X preserves the 
positive cone Y C T*X generated by the normalized connection 1-form a: 

Y = {[x, ra^) : x e X, r > 0}. (4) 

It is well-known that since is symplectic Y is in fact a symplectic conic 
sub manifold of T*X. 

The moment maps and $ are tightly related on Y: one has 

^ ((x,m^)) = r$(7r(x)), (x G X) (5) 

where vr : X — M is the projection |GSlj . 
We need a further piece of notation |GS2j . 

Definition 1. For u) E X(H) fl i}*^, we shall denote by R^cu = {r - co : r > 0} 
the positive ray through uj. Let furthermore O = O^) C g* be the coadjoint 
orbit of oj. We shall denote by C{0) C g* the positive cone over C, that is, 

C{0) = {rX: r > 0, A G C}. 



Notice that $ : M — > g* is transversal to C{0) if and only if so is 
Since \Ef|y is conic, the latter condition is in turn equivalent to the 
one that \Ef|y be transversal to O, and by G-equivariance this is in turn 
equivalent to the condition that ci; be a regular value of '^\y- Hence, in view 
of the invariance of the connection 1-form, conditions ii) and iii) below are 
equivalent to the one that uo should lie in an elementary fundamental wedge 
for the induced Hamiltonian action of G on Y , in the terminology of |(7S2j . 
page 357. 
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Theorem 3. Suppose G is semisimple, compact and connected. Given lu G 
X{H) n suppose that 

i) : ^ $(M); 

ii) : $ is transversal to G{0); 

Hi): the stabilizer subgroup G^ ^ G of u acts freely on ^^-"^ (M+tu) (equiva- 
lently, acts freely on 

Then there exist smooth G-invariant functions 

hr.'^-\G{0))^R f^ = o,i,...; 

with 60 > such that for every choice of orthonormal basis of 
H^{M, L®'^)(^^) for £=1,2,..., there is an asymptotic development 

l,j l>0 

uniformly in p & (C(C)). Furthermore, 

J2\\4'^\p)\f = Oik-''), iV = l,2,..., (7) 

uniformly on compact subsets of M \ {C{0)). 

Corollary 3. Under the hypothesis of Theorem\^ there exists k^j such that 
for k > the base locus of the linear series |iJ°(M, L®*^)(^) | satisfies 



Bs(|i/°(M,L®'=)(^)|) CM\{G-W ^ 

where W = (C(C»)). 

By restriction of the arguments in the proof of Theorem we have: 

Corollary 4. If the hypothesis of Theorem\^are satisfied on a G-invariant 
open set M' = M \ B , where B C M has measure zero, then the same 
conclusions hold for p G M' . 

Example 1. If Qps is the Fubini-Study form on F\ let =: 27rl (nps) + 
(^Fs); where VTj : P-*^ x — > P^ is the projection on the i-th factor 
(i = l,2). Consider the diagonal action of SU(2) on (P^ xP^, The moment 
map $ : P^ X P^ — > su(2)* for this action is g) = 2$(p) + where 
$ : P^ ^ su(2)* is the moment map for the action on (P^,!]^?^). We may 
equivariantly identify P^ with the unit sphere S'^ and su(2)* = su(2) = R^, 
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so that $ corresponds to the inclusion t : ^ M.^. Then the hypothesis 
in Theorem El and its Corollary |3] are satisfied on the complement of the 
diagonal, M' = (P^ x P^) \ Api (strictly speaking, after replacing the action 
of SU(2) on P^ by the action of S0(3) on S"^). If H denotes the hyperplane 
line bundle on P\ the line bundle on P^ x P^ associated to is L = H'^'^MH. 
Set V = C^. For every A; > 1, 

H\F'^ X F\L®'') = Sym^^V*) ® Sjm''{V*) ^ Sjm^'"'^^ {V*) . 

0<j<k 

For any integer r > 1, let H^{F^ x P\L®'=)(^) C H°{F^ x P\ L®*^) be the 
subspace corresponding to the direct sum of the terms Sym^'^~^-^(V^*) with 
3k — 2j = (modr). By the Theorem and its Corollary, for any fixed 
{p, q) G (P^ X P-*^) \ Api and any fixed integer r > 1 the asymptotic growth 
as A; — +00 of the local size at (p, q) of the linear series if°(P^ x P""^, L®^){^r) 
grows like ar{p, q)k'^ for some ar{p, q) > 0. 

These results are based on the microlocal description of the Szego kernel 
given by Boutet de Monvel and Sjostrand in (BSj . In particular, TheoremlHlis 
proved by giving a similar microlocal description of the orthogonal projector 
associated to the linear series H^{M, L'^'^)(^^). To this end, we shall also rely 
on the microlocal description of a projector associated to ladders of repre- 
sentations given by Guillemin and Sternberg in |GS2j . and on a reduction 
technique used by Schiffman and Zelditch in ^?jZ] . Overall, as the reader will 
easily see, the paper is also largely in debt to arguments from jCilSlj . |SZj 
and [Zj. 

In future work we shall consider extensions of these results to the almost 
complex setting, and further investigate the asymptotic growth of the spaces 
of equivariant sections. 

Acknowledgments. I am endebted to the referee for some fruitful and 
stimulating comments. 

1 Proof of Theorem [T] 

Let L* be the dual line bundle of L, with the induced Hermitian metric and 
connection, and let 

p:L*^R, {x,v)^\\v\\l 

be the associated square norm function. Let X G L* he the unit circle 
bundle: 

X = {{p,v) : p{{p,v)) = l}, 
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with projection tt : X — * M. We shall denote by p, g, . . . points in M, and 
by X, . . . points in X. 

By the ampleness of L, X is the boundary of the bounded strictly pseu- 
doconvex domain D = {p <1}. \{ ia is the connection form on X, then a is 
a contact form, da = 7t*{Q) and a A 7r*(f2)^"' is a volume form on X. Given 
this, we shall implicitly identify functions and half-forms. 

There is a canonical isomorphism for every k between the spaces of smooth 
sections of L^'' on M, C°°(M, L^''), and the spaces C°°(X)fc of smooth func- 
tions on X of the k-th isotype for the S'^-action. We shall occasionally denote 
by C C°°(X)k the subspace corresponding to a subspace V C C°°(M, L®'^), 
and occasionally not distinguish between the two. 

Let n G T>'{X X X) be the Szego kernel, that is, the distributional kernel 
of the orthogonal projector vr : L'^{X) —>■ H{X), where H{X) is the Hardy 
space of boundary values on X of holomorphic functions on D. If {s^'^^}^^ 
is an orthonormal basis of H^{M, L®^) for every > 0, viewed implicitly as 
a space of CR functions on X, we have 

+00 

n(a;, y) = ^ nfc(x, y) (a;, y eX), 

k=0 

where 

Uk{x,y) = ^ sf\x)(^sf\y) {x,yeX,k> 0). (8) 
i=i 

As proved in [BS:, 11 is a Fourier integral with complex phase. More precisely, 
it is microlocally equivalent to an oscillatory integral of the form 

r+00 

Il{x,y)= e''^^^'y^s{x,y,t)dt {x,y e X), (9) 

where s G S'^{X x X x R_|_) has an asymptotic expansion 

00 

s(x,y,t)~5^s,(x,y)t"-^\ (10) 
i=o 

The restriction to the diagonal of the principal term so(a;, x) is given explicitly 
in equation (4.10) of (BS) : 

s,{x,x) = ^det{Lx{x))-\\dp\\ (xeX), (11) 

where Lx is the Levi form. We refer to |BSj . [Z], |SZj for a discussion of the 
phase ip G C°°{L* x L*); it parametrizes an almost holomorphic Lagrangian 
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submanifold, whose real locus is the wave front of 11. This is the isotropic 
conic submanifold 

S = {(x, ra^, X, -ra^) : x e X, r > 0} C T*{X x X). (12) 

The Taylor series of ip along the diagonal A^,. G L* x L* is completely 
determined (equivalently, ip is uniquely determined up to a function vanishing 
to infinite order along Al*)- Explicitly, if x G L*, in local holomorphic 
coordinates induced by a local holomorphic frame for L in a neighbourhood 
of 7i{x), we have 

Hx + h,x + k) -J2 ^^(x) ^ {Kke C"+^). (13) 

We can retrieve 11^ in (jHl) as the A;-th Fourier component of 11: 

Mx,y)= / e-"''e''^^''^'yh{rex,y,t)dtde {x,y e X), 

Jo Js^ 

where r : (e*^,x) & x X rg{x) G X is the S^-action on X; application 
of the stationary phase lemma gives an asymptotic expansion for 11^ in terms 
of which many classical results in algebraic geometry can be deduced [Z]. 

Given the direct sum decomposition we may take as an orthonor- 
mal basis for if°(M, L®*^) the union of a collection of ortho normal basis 
{sf of H^M, L®'')^ for each oj G X{H) n \)\. Thus, 

^k{x,y)= ^ likA^^y) {x,yeX,k>0), 
ujeX{H)nt)l 

where 

n,,.(x,i/) = ^ '"^x) ®sf '")(!/) {k>o,u;e x{H) n f^;). 

If X G X and p = tt (x) , we have 

IiuA^.x) = Y,\\sf-\v)\?. 
i=i 

Thus we want to study the asymptotic behaviour of 'n.k,u{x-,x) for a fixed u 
and X G tt"^ ($"^(0)) as k ^ +oo. 
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Clearly, 11^ is the k-th Fourier component of the equivariant Szego kernel 
G V{X X X) associated to uj, that is, the distributional kernel of the 
orthogonal projector 

TT^ : L\X) H{X)^, 
where we have set _^ 

kez 

Thus, Huj^k G C°°(X X X) is the distributional kernel for the orthogonal 
projector 

Let : L'^{X) L^{X)i^ be the orthogonal projector onto the G- 
equivariant Hilbert subspace of L'^{X) associated to uj, let : L'^{X) 
L^(X)fc be the orthogonal projector onto the k-th isotype for the S'^-action, 
and let vr : L'^{X) H{X) be as above the orthogonal projector onto the 
Hardy space of CR functions. Then 

T^uj,k = Pujogkon- (14) 

Let G be a compact topological group and a : G —>■ U{V) be a finite 
dimensional irreducible representation. Let g : G —>■ U{W) be a unitary 
action on a separable Hilbert space, and let Wy ^ W he the equivariant 
G-suspace associated to a. Then the orthogonal projection operator Hy : 
W — ^ Wy is given by 

Hy = dim{V) ■ / ^(^f) Xa{g'^) dg, 
Jg 

where Xa is the character of a and dg a normalized Haar measure on (7 |D]. 

To simplify notation, let us denote by ft both the linearization to L of the 
action of G on M, and the induced actions of G on L* and X. Under the usual 
identifications, the linear representations of G on the spaces H^{M, L®^) are 
then given by pull-back of CR functions on X under this action. Thus, 

nfc,<^(x, y) = dim(K;) ■ / xM^^) Qio) (J^kix, y)) dg 

Jg 

= dim(VL) ■ / Xuj{.9'^)^k{,iJ'g-i{x),y)dg 

JG 

= dim(K.)- / / e-^'=V*H^--'^W'^) .^^(^-i). 

Jo Js^ Jg 

■s{jlg-i o r0{x),y,t) dt dO dg {x,y E X) (15) 
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By assumption, G acts freely on $^^(0). We may thus find an open neigh- 
bourhood U of the unit e G G and e > such that d{p, gp) > e if p e $"^(0), 
g ^ U. If X = y E TT^^ ($^^(0)), the integral (fT5|) may thus be decomposed 
as follows: 

nfc,a;(a;,x) = dim(K;) ■ / Xa{9'^)^k{fig-i{x),x) dg 

Ju 

+ dim(K.)-/ Xa{g'^)'n.k{flg-^{x),x)dg, (16) 
Jg\u 

the latter term being 0{k^^) for every = 1, 2, . . . as ^ +oo, uniformly in 
X G 7T~^ ($^^(0)). Let us focus on the former term, which we call Ilk,uj{x,xy . 
Setting t = ku, this may be rewritten 

n,,^(x,x)' = k dim(K.) ■ / / ^^k[u^{^.^.,oM.u)-0] . . 

Jo Js^ Ju 

■ s{jlg~i o tq^x), X, ku) du dO dg 

= fcdim(K.)- / / / e^'=*(^-'"-^'^)-x.(^7-')- 
Jo J Ju 

■s{jlg-i o r0(x), X, ku) du dO dg. (17) 

From the corresponding property oi it follows that the phase 

\l/(x, M, 0, g) = uip[jlg-i o rg(x),x) — 9 

has positive imaginary part. Therefore, ()17|1 is a complex oscillatory integral, 
and its asymptotic behaviour as k +oo is determined by the stationary 
points of the phase function of {g,6,t). 

Lemma 1. Suppose x G $^"'^(0). Then (e,0, 1) is a non-degenerate critical 
point of \1'. Furthermore, perhaps after replacing U with a smaller open 
neighbourhood of e E G, it is the only critical point of'^ in U x x (0, +oo). 

Here, of course, we implicitly identify 9 with e*^. 

Proof of LemmaU\ Let us first show that (e, 0, 1) is a critical point of \E'. We 
have 

/ie o ro(x) = X and (#)(x,x) = {x, a^, x, -a^). (18) 

The connection on L induces a G x S^-invariant direct sum decomposition 
TX = H[X/M) © V{X/M) into a horizontal and a vertical subbundle; here 

H{X/M) = ker(a) and V{X/M) = span {^} 

12 



denotes the generator of the S^-action on X). If ^ 0? l^t and 
denote, respectively, the vector fields induced by ,^ on M and X. If is a 
vector field on M, let V'^ denote its horizontal lift to X. Then, in terms of 
the above direct sum decomposition of TX, we have for all ^ G g jCilSlj : 



where 0^ = 
particular. 



M - 



(19) 



is the ^-component of the moment map. In 



ix{x) = CaA^) for every { G if $(7r(x)) = 0. 
Let us introduce the map 

-.R^ X X X, (/iexp{to(3;)5 ^) ■ 

Given and 



(20) 



(e,l,0) 



d 

di 



{a^{-t)x, x) = (c/^)(.,.) (-ex(x), 0) = 0, (21) 



t=o 



for every ^ G 0. On the other hand, it follows from the arguments on pages 
327-328 of [Z] that (1, 0) is the only critical point of \E'(x, e, 6, u) as a function 
of {9,u); more precisely, we have 



{x,e,8,u) 



-i (1 - e^^) and (dg^H) 



{x,e,8,u) 



1. 



(22) 



Furthermore (1, 0) is a nondegenerate critical point of \E'(x, e, 6, u) as a func- 
tion of {9,u), and the Hessian is given there by 



i 1 
1 



(23) 



We can now prove that (e, 0, 1) is a nondegenerate critical point of Per- 
haps after restricting to a smaller open neighbourhood of e G G, we may 
suppose that U is diffeomorphic to an open neighbourhood of G under 
the exponential map; having fixed a basis of g, let {hi, . . . , hg) {g = dim(G)) 
be the resulting coordinates on U centered at e. By the above and the expres- 
sion of \E', it is clear that = 0. Given this and (|^. the Hessian 

^ " (e,l,0) 
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of "^{x, g, 6, u) in the coordinates (/ij, 9, u) at (e, 0, 1) has the form 



92^ 



92^ 



(e,0,l) 



dhidhg 



(6,0,1) 



dhi 







(6,0,1) 

(e,0,l) 



dhide 



(e,0,l) 



(e,0,l) 



(e,0,l) 



(e,0,l) 



1 





Therefore, 



det (i/(^)) = det 



92^ 



^2^ 



92 q, 



(e,0,l) 



dhidhg 



(e,0,l) 



y dhgdhi 
( 



det 



V 



(e,0,l) 



92 y, 



dhi 



(e,0,l) 
92^ 



dhgdhi 



dhidhg 



9V 
9/x2 



(24) 



where ip : U — » C is the function g ^ ip {fig-i{x),x). That (e,0, 1) is a 
nondegenerate critical point then follows from the following 

Lemma 2. The Hessian of ip at e, H{ip)e, is nonsingular. 

Proof. We first produce an appropriate set of local holomorphic coordinates 
on M in the neighbourhood on p = 7r(x) and on L* in the neighbourhood of x, 
in terms of which the action of G will be a translation. Let Mq =: $~^(0)/G 
be the symplectic reduction of M. Then Mq is an (n— (7)-dimensional complex 
manifold and has an induced Kahler structure. Let a : $~^(0) — > Mq be the 
projection (a principal G-bundle) and set p = a{p). We claim: 

Lemma 3. There exist an open neighbourhood T ofpin Mq and a section 
a : T $^"'^(0) of a, such that a{p) = p and a is holomorphic as a map 
T ^ M. 



Proof. For q G M, let Fq C TqM C be the +i-eigenspace of the complex 
structure Jg G End(TqM). 

Next, if p G $"H0), recall that Tp ($"^0)) C TpM is a coisotropic sub- 
space, with symplectic complement Tp ($"^(0))"'" =Tp{G ■ p) [ GSlj . 
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By assumption, $ is submersive at p G $^^(0). Let B be an open neigh- 
bourhood of p on which $ is a submersion and the action of G is locally 
free. Then C =: $(-B) is an open neighbourhood of G g*. For c G C, let 
Wc = $~^(c) n B. Then Wc is a (2n — (?) -dimensional real submanifold of 
B. For g G -B let us set Rq =: Tg , the symplectic complement of 

By Lemma 3.6 of ICilSlj . we have Fp fl {Rp®C) = 0; therefore, per- 
haps after restricting S to a smaller open neighbourhood of p, we have 
Fg n{Rq®C) = for all q E B. 

It follows that F^ =: F^n (Tg {W^(q)) ® C) is a complex distribution on B, 
of complex rank n — g. Being the intersection of two integrable distributions, 
it is itself integrable. 

Thus we may apply the complex Frobenius integrability theorem: there 
are local holomorphic coordinates rj on S C M centered at p such that 
F' = {d/drj : j = 1, . . . , — g}. Lemma El follows from this. 

Let us now return to the proof of Lemma |21 Let Zi, . . . , Zn-g be local 
holomorphic coordinates on Mq centered at p, and defined on an open neigh- 
bourhood T C Mo of p. We may assume that the Zj's are induced by a 
biholomorphic diffeomorphism x '■ Bn-g{0,l) — > T, where Bm{w,r) denotes 
the ball centered at the origin and of radius r > in C". 

Let flc ® C be the Lie algebra of the complexification G of G. Let 
•S* C be an open neighbourhood of on which the exponential map exp^ : 

^ G restricts to a biholomorphic diffeomorphism S ^ S' =: expQ^S). 
Upon choosing an appropriate basis of g, which identifies Qc with we may 
assume that S gets identified with Bg{0,l). We now define a holomorphic 
chart on M on an open neighbourhood D of p by setting 

7 : Bn-g{0, 1) X Bg{0, 1) C C" ^ M, {w, z) ^ exp^(«7) ■ a {x{z)) . 

Let us write w = a + ib and z = c + id, for w E and z G C"~^, with 
a, 6 G and c,d E M"^^, and view a, b, c, d as real local coordinates on M 
in the neighbourhood of p . If ^ G g has coordinates a = (ai, . . . , a^)* G 
in the chosen basis of 0, we have 

We now construct local holomorphic coordinates on L* centered at x. 
By G-invariance, L, hi, V l descend to objects Lq, /iq, Vq on Mq. More 
precisely, with obvious notation, if t : $^^(0) ^ Mq is the inclusion, we have 
t*(L, hi^V l) = o:*{Lo, ho, Vq). We choose a local holomorphic frame Clq for 
Lq at p, which perhaps after restriction we may assume defined on the open 
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neighbourhood T of Lemma El We shall view this as a holomorphic section 
of L defined on the complex submanifold Q;(T) of M, and may assume with 
this identification that eLQ(p) = x. Using the holomorphic action of G on L, 
we may then extend to a section of L over the open neighbourhood 
D of p in M by setting 

Cl (exp^(w) ■ a{q)) = exp^{w) ■ eLo{(T{q)) {w e S,qe T). 

Let be the dual frame. The choice of then induces a holomorphic chart 

7 : 5„_g(0, 1) X 5^(0, 1) X C =: . 

We have, with ^ G g and a G as above, 

7"^ (expG(tO -x) = (to, 0,1). 

Let now jd =: ||e2||^, so that /^""'^/^e^ is a unitary frame of L* over D. We 
have an induced trivialization 



7 : 5„_,(0, 1) X 5,(0, 1) X ^1 =: X* 



\D 1 



and since the action of G preserves the metric we still have, with ^ G and 
a G as above, 

7-MexpG(tO-a;) = (ta,0,l). (25) 

We now estimate ip (/ioxpg(-to(^)' second order using the Taylor 
expansion of if) at (x,x), and (fT^ . Since ^x(a^) = X]?=i '^t ^ 
horizontal in view of p9|) and because x G $~^(0), it is annihilated by the 
connection form a^.. Thus d(x,x)'4^ ((ct, 0)) = 0, and we have 

(/iexpG(-to(^)'^) = V'(a;,a;) + ^t^a* iJ(?/i)e a + O(t^) 
= V'(a:,x) + ]f H{p)^}'\ix{x)) + 0(t=^), (t G R). 

where 

Thus Lemma |21 may be rephrased as: 
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Lemma 4. The quadratic form G Sym^ (g* ® C) given by 

a.:^eg^Hip)f''\^xix)) (26) 
is nondegenerate (clearly C,l*{x) = C,x{x) when x E X). 

Proof of Lemma^ Let H{p)x be the Hessian of p at a; G X C L*, in local 
holomorphic coordinates induced by some holomorphic trivialization of L in 
the neighbourhood of p = 7r(x); we may decompose it into types, as 

H{p). = Hip)(^''^+HipY^''^+HipY^'^\ 

where 

Since p is G-invariant we have, for any ^ E q: 

= H{p)4^x{x)) = i/(p)^°H^x(x)) +if(p)^^)(ex(x)) 
+m^^''K^x{x)) = HipY^'^-^i^xix)) +2Re{H{pY^^^^ (27) 

as p is real-valued. By p9|) . if x G $^^(0) then ^x(3;) is horizontal, that is, it 
lies in the maximal complex subspace Hx{X/M) of Tx{X) C Tx{L*). By the 
ampleness of L, the Levi form Lx{p) induces a positive definite Hermitian 
form on Hx{X/M). In turn, because G acts freely on $~^(0), the induced 
real quadratic form on g, 

^^L^ip){^xix)) =: H{p)^j^'\^xix)), 

is positive definite. This proves Lemma |31 because a complex symmetric 
matrix with negative definite real part is nondegenerate. 

Hence (e, 0, 1) is a nondegenerate critical point of \E'. We still have to 
prove that, perhaps after restricting f/ to a smaller open neighbourhood of 
e G G, it is the only critical point of \1' on f/ x x (0, oo). 

Now (0, 1) is the only critical point of \E'(x, e, 9, u) as a function of {6, u). 
Therefore, given any e > we may replace U with some possibly smaller 
open neighbourhood of e, so that (e, 0, 1) is the only critical point of \l/ 
in ?7 X S"^ X (1 — e, 1 + e). Suppose that there is a sequence {gi,9i,ti) of 
critical points of \E' with gi e. Since is compact, the sequence 6i has 
some accumulation point 6*00 , and after passing to a subsequence this implies 
{d'^)(^e,eaa,ti) — ^ 0. By ((221), must have 6^00 = and — > 1, against the fact 
that |tj — 1| > e. 
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This completes the proof of the Lemma. 

We are now in a position to apply the complex stationary phase Lemma 
to estimate the asymptotic behaviour of (fTTjl as — > +00 jHj, |MSj . More 
precisely, since = dim(V^), 

T^kA^,xy ~ dim(VL)' det {H{^){e,0,l)/2m)-'/^ so{x,x) 

+0 . 

Theorem n follows in view of (jllj) . and Lemma El 



2 Proof of Theorem |2l 

We have 

dimH\M,L''% = [ U^4x,x)dx, (28) 

Jx 

and we want to estimate asymptotically the latter integral as — >■ +00. 
As we have seen, the equivariant Szego kernel 11^^ ^ is given by 

n.,fc(x,i/) = 7^ / / e-^'^'x^ {g-') n (e%-i(x),y) dOdg {x,y e X). 
Jo Jg 

Here /i is the action of G on X, and p is induced by fi by the formula 
= f{f^g-^ix)) ixeX,ge G). 

By compactness and the results of |BSj . we may find Eq > with the 
following property: For any p E M and e > 0, let B{p,e) be the open ball 
in M centered at p and radius e, in the geodesic distance on M. Then 
on the inverse image (vr x vr) {B{p, 2eo) x B{p, 2eo)) the Szego kernel is 
microlocally equivalent to a Fourier integral operator of the type 

We shall denote by distM the geodesic distance function on M, as well as 
its pull-back to X, and by distx the geodesic distance function on X. Here 
the Riemannian metric on X is defined in the natural manner in terms of 
the metric on M and the connection, so that the projection vr : X — > M is a 
Riemannian submersion; distx is clearly S'^-invariant. Let us set: 

V= {{x,g) eX xG : distM {x,fig-i{x)) < e^} . (29) 

V is an S'^-invariant open neighbourhood of X x {e} in X x G. We now 
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decompose the integral as follows: 



Jx 

= ^j^j^jj (^~'''X.{9'') Ii{e''^lg-.{x),x) dOdgdx 

= j j Xu; (g^^) Ilk{Hg-i{x),x) dxdg 

+ 11 {g'^) ^k{fJ'g-^{x),x) dxdg 

J JxxG\V 

H^'^'' and H^''^'^ are defined by the latter equality, h'^'^'^ is 0{k~^) for every 
= 1,2, . . ., since the Szego kernel is smoothing away from the diagonal. 

We thus need to estimate H'f'^'^ asymptotically as /c — > +00. 

To this end, we shall first of all construct an appropriate finite open cover 

of M. Choose points pj G $^^(0) (1 < J < tq for some fixed tq > 1) such 

that 

'•0 

$-'(0k/2C Us(p,,eo); 
i=i 

here $^^(0)£(,/2 is the eo/2-neighbourhood of $^^(0) in M in the geodesic 
distance. 

Let us further choose points pj G M \ $^^(0)£q/2 {j-q + 1 < j < ri for 
some integer ri > tq), such that 

ri 

M\$-i(0),,/2C U i?(p„eo/3). 

j=ro+l 

Clearly, tq and ri depend on cq. 

Let us then set Vj = B{pj, Eq) if 1 < j < tq, Vj = B{pj, Eq/S) if tq + 1 < 
j "£ f'l- This is a finite open cover of M. Let 1 = Ylj^'j be a partition of 
unity subordinate to the cover {V^}. We shall also write (pj for (pj on. Thus, 
1 = will be implicitly seen as a partition of unity on X subordinate to 

the open cover Vj, where Vj = n^^^Vj). 

decomposed as 

^^''^=E // xAa-') M^)^k{f^,-^{x),x) dxdg = J2Af'''\ (31) 
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where Vj = (7) G V : a; G V, | and A^p'^'' is defined by the latter equahty. 

We shall next estimate each Ap'^'' separately. 

By construction, if {x,g) G V then the neighbourhood of {fig~i{x),x) we 
may represent 11 as a Fourier integral of the type 0. 

More precisely, by our choice of Eq, for every j = l,...,ri we may 
choose a preferred holomorphic section of L at pj and adapted local holo- 
morphic coordinates at pj, in the sense of jSZ] , both defined on B{pj,eo). 
We then have induced holomorphic coordinates on L. Let aj = aj{z) be 
the square norm in this preferred frame, and let aj{z,w) be its extension 
to M X M, almost analytic in z, and almost antianalytic in w. This deter- 
mines a phase function ipj{z, A, w, fi) = i {1 — aj{z, w)\]I), restricting to ipj = 

°l(f'"^j_^ _\7t ) on X X X (with A, u G S^). ibj locally parametrizes 

the almost analytic Lagrangian relation associated to the Szego kernel. In 
particular, 

d{x,x)'4' = {d^ip{x,x),d^^{x,x)) = {ax,-ax), 
for every x & Vj. A straighforward computation then gives 

Let s be the classical symbol appearing in the local representation of LI as a 
Fourier integral operator. Setting Sj{y,x,t) = 4>j{x) Sj{y,x,t), we obtain 



2lT f + C>0 



2n J ./i; ./n ./n 

:sj [e^^ fig-i{x), x,t) dxdOdgdt. (32) 



With the change of variables t = ku, this is 

f2n r+co 



^ 27r y JvjJo Jo 

X Sj (^e^^ fig-i{x), X, ku) dxdOdgdu 



k_ 
2^ 



27r p+00 



:sj [e^^ fig-i{x), X, ku) dxdOdudg, (33) 
where \E'j : Vj x 5^ x — > C is defined by 

^!j{x,g,e,u) = uijjj{e^''ijg-i{x),x) - 6. (34) 
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To estimate Aj ' , we shall now use the complex stationary phase Lemma. 
For X e Vj, let "ifx '■ Ux x x (0, +00) ^ C be the partial function 
'^jx{g,9,u) =: '^j{x,g,9,u)] here Ux C G is a suitable neigbourhood of 
eeG. 

Lemma 5. For all sufficiently small sq, there exists 70 > (independent 
of eo) such that Wd'^jxW > 70 eo at any {x,g,9,u) G Vj x x ]R^_ with 
ro + l<j< ri. 

Proof. To begin with, we make the following remark. Given any a, b with 
< a < 1 < 6, there exists d > with the following property: For all 
sufficiently small eo > and {x,g,9,u) with {x,g) G V, we have > d 

if u ^ (a, b). 

If not, there would exist a sequence {xi, gi,9i,Ui) with 

distAf (^fig-i{xi),Xi^ 0, 

Ui ^ {a,b), and d(^Xi,gi,ei,Ui)'^jx 0. Given the compactness of X and G, we 
may pass to a subsequence and assume Xi Xoo, gi ^ goo- Then fi^-i (xqo) = 
e'^'^Xoc, for some -(^oo e [0,27r), and d^xoo,e^^°°xooA,Ui)^jx ^ 0. But by the 
analysis in [Z] of the critical points of this implies 9i —>■ — i?oo) ^ 1, 
absurd. Thus, we may assume u G [a,b]. 

We shall then fix some a G (0, 1) and suppose that eo is sufficiently small 
for the conclusion of Lemma El to hold. 

If {x,g) G Vj, let {} = 'd{x,g) G [0,27r) be uniquely determined by the 
condition that 

distx (e*''/ig-i {x) ,x) = distA/ (/i^-i {x) ,x) < e^. 

Given that di^^iex,x)4'j = (e*^CKe'«x) ~e*^Q^x) for all x G Vj, there exists Ci > 
such that 

(35) 

Suppose now that Tq + 1 < j < ri and p G V^-. Then 

dist [p, $"^(0)) > dist [pj, $^^(0)) - > Eq/G. 

Suppose X & Vj and (x, (7) G V, and set p = tt^x) E Vj. Then 
distM(/ig-i(p),J3) = distM{l^g-^ix),x) < el. 
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(x, g) G V, 



d{^^ ,(e'Ox),x)i^j 



a, 



i{e'(0+^)x)^-<^ "xj 



Therefore, 

distM $"'(0)) > £0/6 -el> £o/r, 

if £0 < 1/42. Thus, given that G g* is a regular value of the moment map, 
there exists C2 > such that 

r-o + 1 < J < n, {x,g) e V, =^ 11$ > 0260, (36) 

in a given fixed norm on g*. In other words, if tq + 1 < j < ri and (x, g) G Vj 
then there exists ^ G 0* of unit norm such that (/ig-i(p)) > C2£:o, where 
p = TT^x) and = This is equivalent to the condition 



a 



i^x (/ig-i(x))) > Cs^o, (37) 



and in view of the above this completes the proof of Lemma El 

We now apply the complex stationary phase Lemma to estimate the sum 
Yl^j=ro+i '^s^j''^ ■ Recalling the definition of H^-'^\ we first integrate over 
9, u, g and then over x. The first integral, given Lemma is < C^k'^ for 
every N = 1,2,.... We thus obtain 




< CNk-^ / ^ (hA dx< Clk~^. 



j=r 0+1 

In order to estimate Yl]=i we shall use in the neighbourhood of any 

X G 7r~^ ($~^(0)) the local coordinates (w, z, A = e*^) discussed in the proof 
of Lemma El Thus w G C^, ^ G C"~^ and \ & S^. We shall write w = a + ib 
and z = c + id, where a,b E W and c, G M"-^. Then Tr^^ ('^'"^(0)) is 
locally defined near x by the equation {b = 0}. In the neighbourhood of 
(x, e, 1, 1) G X X G X S"^ X M we then have local coordinates (a, b, c,d,X = 
e*^, a', X' = e*^ ,u). In the following we shall not distinguish between \i/ and 
its expression in local coordinates. 

Loosely speaking, vr^^ ($^^(0)) x {(e, 1,1)} is a nondegenerate critical 
manifold for the (locally defined) phase \I'. 

Lemma 6. Every x G ($^^(0)) x {(e, 1, 1)} is a critical point of^. The 
Hessian of \E' at any x G ($^^(0)) x {(e, 1, 1)} has rank 2g + 2, and is 
nondegenerate in the variables {b,a',6',u). 

Proof. By the previous discussion, vr^^ ($^^(0)) x {(e, 1,1)} is a critical 
manifold for \E'. Thus the Hessian of \E' at any x G vr^^ ($^^(0)) x {(e, 1, 1)}, 
H[ijj)x, is a well-defined quadratic form on the tangent space to X x G x 
S"^ X R at x. Suppose without loss of generality that the local coordinates 
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(a, b, c,d,X = e ) are centered at x. Clearly, every second derivative of 
^ involving one of the variables a, c, d, 6 (which give local coordinates on 
TT^^ ($^^(0)) X {(e, 1, 1)}) vanishes at x (incidentally, given the expression in 
local coordinates of the phase ip discussed in jZ], \l/ does not depend on A). 
We want to show that H{ip)x is nondegenerate on the subspace 





d 


d 


d 












} 



Let us then consider then the {2g + 2) x [2g + 2) matrix given by Hessian of 
\E' at X in the variables {b, a', 6, u), H{ip)x. To begin with, let us remark that 

Claim 2.1. 



duda' 



0, 



dudb 



0. 



Proof. By definition. 



^ = The first vanishing then holds because 
d{x,x)'^ = {cix, ~<^x), where a is the connection 1-form, and as we have seen 
the action of G at x G vr"^ ($~^(0)) is horizontal to first order. The second 
vanishing holds because ip is constant along the diagonal. 

As recalled in the proof of Theorem ^ the Hessian of in the two variables 
6', u at (0, 1) is known from [Z^. Given the Claim, we obtain for the Hessian 
in 6, a' 0' u: 



det H{'^)x = det 



da' db 



92 



da' db 
da'2 



det 



db2 



da' db 



da' db 

d^ 
aa'2 



Claim 2.2. 



52^ 



962 



0. 



Proof. If we fix g = e,6' = 0, u = 1, = ip is constant as a function of x. 
Thus, 



det H{'^)x = det 







da'db 



da'db 
aa'2 



and we are reduced to proving that the g x g symmetric matrix 



92* 



da' db 



da' db 
^ = 



is nonsingular. We shall do this using the second order expansion of 

ip as a function of a' and b keeping fixed a = 0, ^ = ^' = 0, m = 1. 
In so doing, we shall use the Taylor expansion of ip (as a function on L*) 
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at {x,x)] this is determined as we have seen by the Taylor expansion of the 
square norm function g. 

In the notation of the proof of Lemma |2l let 7(0 + 26, c + id), 7(0 + 26, c + 
id, z) and 7(0 + i6, c + id, A) be, respectively, the local charts of M, L* and 
X C L* near p = 7r(x) and x; here a, b E W, c, d E M""^, z E C, \ E S'^. 
Thus, 

7(0 + ib, 0) = exp(a + ib) ■ p, 
7(a + ib, 0, z) = exp(a + ib) ■ {p,zel{p)), 

7 (a + 26, c + id. A) = 7 + 26, c + id. A/ a/ /5 (7(0 + ib,c + id))^ , 

where (3 = ||e2||^. To simplify notation, we identify a + ib E with the 
corresponding vector in Qc, given the implicit choice of a fixed basis of g. We 
also write g = exp(a + ib) for its image in G under the exponential map. 
With some further abuse of notation, in the following lines we shall omit 
the variables c, d: for example, ^{itb,X) will then really mean 7(2^6, 0, A), 
where A = e*^. 

We shall also let p = vr(x), so that 7(0 + ib) = exp(a + ib) ■ p, and 
X = (p, e2(p)). By construction of e^, if a' E and t G M is sufficiently 
small, we have 

exp(t a) ■ {q, A el{q)) = (exp(t a') ■ q, A el{exp{t a') ■ q)) , 

for every q E M near p and A G C. In particular, if g = 7(z tb) = exp(z tb)-p, 
we have 



7(2t6,A) = e*"'- (7(2^6), Ae2(7(2t6))) 



[p,\~el{p)) 



e ■ e 



= (^e*"'e**'-p, Ae2(e*'^'e'*'-p)). (38) 

Since exp(t a') exp(2 1 6) = exp {t[o! + i6) + {i/2)t^ [a! .b] + 0(i(:'^)j, we may 
rewrite this as 

e*"' ■7(zt6,A) = 

= j^gt(a'+i6)+(i/2)t2[a',b]+0(t3) . ;^ g* (e* ^)+(''/^) -p)) 

= 7 (t (a' + 2 6) + (V2) [a', 6] + 0{e), A) . 
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We have for a', 6 G and t G M sufficiently small: 
Identifying -0 with its expression in local coordinates this is 

i, {(i (»' + a) + (./2) «^ K. 6] + 0(e), . (, t „, -5^^) ) . 

Now, as we have mentioned, the action of G on X C L* is horizontal 
over ^~^{x). Thus, given that tt{x) G ^^^{x), for every ^ G g the asso- 
ciated tangent vector = C,x{x) G H{X/M)x- The latter is the max- 
imal complex subspace of T^L* contained in T^X. Therefore, we also have 
Jx{,ix{,x)) = {i^)x{x) G H{X/M)x. Now, in more intrinsic notation, suppose 
a', h & W correspond to ^ G g, respectively; then, in the local coordinates 
provided by the holomorphic chart 7, (a', 0) stands for (x), (6, 0) for ^l* {x), 
and (^&, 0) for JxC,l*{x) {J^ is the complex structure on T^L*). Thus, on the 
one hand in our local coordinates 

ax{t{a +ib) + {i/2)t'^[a,b],0) =0, ax{itb,0) = 0. 

On the other hand, the path '^{itb) is tangent to X at t = 0, and therefore 
l3{j{itb))~^ = l + t"^ s{t) for some smooth function s(t). Given that d(^x,x)4' = 
{axj—dx), where a is the connection 1-form, we conclude from the latter 
expressions that 

* tb,l), e-'^',0, 1, ) = ^ H{^)^x,.) {a' + lb, tb) + 0{t^). 
In view of (|T!?jl . 

H{ij)ix,.){a' + lb, tb) = H^^'^\Q)x{a' + z6, a' + ib) 

+H^^'^\g)xia' + lb, lb) + ib). (39) 

Since ip{x,x) vanishes identically for x G X, 

for every t, and therefore in the terms containing only b add up to zero. 
Using the symmetry and the C-linearity of H^'^''^\q) and the sesquilinearity 
of H^^'^\g), we obtain 

H{tp)(x,x){a' + ib,ib) = 

= H^'''\gUa',a')+t{2H'^'''\g)x - H^'''\g)x){a ,b). (40) 
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Thus, the g x g complex matrix —i q^, 
X g C given by 



represents the bihnear pairing 



The latter is in turn the restriction of a similarly defined M-bilinear pairing 
on g^. We have seen in the proof of Theorem ^ that the former term is 
represented by a complex symmetric matrix with negative definite real part, 
while the second term is a negative definite Hermitian product on Qc- The 
proof of Lemma El is then completed by the following: 

Lemma 7. Let b > 1 be an integer. Let C and H be complex b x b matrices. 
Suppose that C is symmetric and H is Hermitian. Suppose furthermore that 
C has positive definite real part, and that H is positive semidefinite. Then 
C + H is nonsingular. 

Proof. By the hypothesis, C = A + iB, H = R + iS, where A, B, R, S are 
real 6x6 matrices satisfying: A* = A, B^ = B, and A is positive definite; 
Rt = R^ s' = -S and 

{V' + iW'){R + tS){V -tW)>0 

for all V,W E M!', and equality holds if and only if V = W = 0. Suppose 
that X + iY E ker(C + H), where X,Y E M^ We have 

(X* - iY^) (^R + iS^ {X + iY) = X^RX + Y^RY - 2X^SY > 0, (41) 
for all X,Y E M^ On the other hand, 

(^{A + R)+ i{B + S)) (X + lY) = 

= (^{A + R)X - (5 + 5)r) + z ((fi + S)X +{A + R)Y^ . (42) 

Thus, {A + R)X = {B + S)Y and {A + R)Y = -{B + S)X. Let us multiply 
the first relation on the left by X* and the second by F*, and sum: we get 

{X^RX + Y*RY) + {X^AX + Y^AY) = 2X^SY. 

In view of Mlj) and the positive definiteness of A, we conclude X^AX = 0, 
Y^AY = whence X = Y = 0. 

To complete the proof of Theorem |21 we now only need to observe that 
the asymptotic expansion described in the statement holds for Yl^i=i '^3^i''\ 
in view of Lemma El and the complex stationary phase Lemma. 
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3 Proof of Theorem El 



To ease the exposition, let us first prove Theorem El under the following 
additional simplifying assumption: 

G lies in an elementary fundamental wedge for the Hamiltonian action 
ofG on T*X \ {0} (;GS21, page 357). 

Recall that this means that is a regular value of the moment map 
* : T*X \ {0} ^ 0*, and that C G acts freely on ^~\uj). 

To begin with, let us then first of all clarify the relation between the 
symplectic cone Y and the submanifolds 

W =: {G{0)) CM, Z =: {G{0)) C T*X \ {0}. 

In view of , if p G X and r > then 

(p, rap) G r n ^ 7r(p) G (C(C)) . 

In other words, we have 

Lemma 8. Let tt : Y ^ M be the projection, {x,rax) tt{x). Then 

YnZ = n-^{W). 

Furthermore, ^ $(M) clearly implies: 

Lemma 9. W O M is compact. 

Recall, after |GSlj . that Z and W are fibrating coisotropic submanifolds 
of T*{X) \ {0} and M, respectively. More precisely, there exist symplectic 
V-manifolds in the sense of Satake 

{z\nz») and {wKnw»), 

and smooth maps pz '■ Z Z'^, pw : W W'^ whose fibres are the leaves 
of the corresponding null foliations. Thus, ii lz '. Z T*{X) \ {0} and 
Lw '■ W ^ M are the inclusions, then = pK^^tt) and l\y{S^m) = 

p'\^{yLyi/i), where VLt*x, ■ ■ ■ denote the symplectic structures of the manifolds 
T*X, . . .. The fibre of pz (respectively, of pw) through a point p E Z (resp., 
X G W) is the orbit of a certain normal subgroup Hf of the stabilizer subgroup 
Gf under the coadjoint action, where / = ^{p) (resp., / = $(x)). The Lie 
algebra f)/ of Hf is the codimension one ideal of 0/ = Lie(G/) given by 
(jUHl, page 351): 

f)/ = {eGg/:</,e>=0}. (43) 
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Let R he a symplectic manifold. Given an isotropic submanifold S C 
R X R, we shall denote by S' the corresponding isotropic relation, that is, 
the image of S under the map (ri,r2) ^ (ri, — r2). Clearly S' is an isotropic 
submanifold of i? x R~ , where R~ denotes R with the opposite symplectic 
structure. The fibre products 

Z Xp^ Z and W Xp^ W 

are then Lagrangian relations in T*{X x X) and T*{M x M), respectively. 
We shall in a while be interested in the composition of the conic isotropic 
relation E', with S given by p2|l . with D =: [Z Xp^ Z). The previous 
discussion obviously implies: 

Lemma 10. S' o D = n-\W) Xp^ n'\W). 

More explicitly, given that a is G-invariant we have 

fc~\W) Xp^ n-\W) = {((x,ra^), {y,ray)) : 7r(x) G W, 

y e H^(^^(^^)yx,r >0} . (44) 

With the standard implicit identification between sections of L^'^ and 
S^-equivariant funcions on X, let 

H{X)i^) =: 0i/°(M,L®'=)(^) = H\M,L^%^ C H{X) C L\X), 

k>0 k,e>0 

and let P(^) : L'^{X) be the orthogonal projector. If jsj^'^'^^j is 

an orthonormal basis of H^{M, L®^)i^ for k,i = 1,2,..., the Schwartz kernel 
of P(^) is 

PH(x,y) = Y.sf''''\x)^sf''''\y) {x,y G X). 

k,l 

The k-th Fourier component of P(a;) is 

e 

and we want to estimate asymptotically the diagonal behaviour of P(a;),fc on 

To this end, we shall describe P(^) as a Fourier integral operator with 
complex phase and study the geometry of the associated (almost complex) 
canonical relation. In fact, P(tj) is the composition of two Fourier integral 
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operators whose associated canonical relations are related to the G-action 
and to the complex structure, respectively. Namely, let 

and denote by : L'^i^) L'^{X){uj) the orthogonal projector. If 11 
denotes, as above, the Szego projector, then P(^) = Q(^) o n. 

As mentioned already, 11 is an elliptic degree zero Fourier integral ope- 
rator with complex phase; its almost complex Lagrangian submanifold C is 
locally parametrized by the phase function tp, and can be characterized ge- 
ometrically as follows ( |BSj . Propositions 2.13 and 2.16). Let X denote a 
complexification of X |MSj . so that the natural (complex) symplectic struc- 
ture on the cotangent bundle T* {X) is the complexification of the symplectic 
structure on T*(X). Let ( = {Q} be the symbol of the boundary Cauchy- 
Riemann operator df,, a smooth function on T*{X), and let ( = {(j} be its 
almost analytic extension to T*{X). 

Theorem 4. (}BS^ ) Let T C T*{X)\{0} be the almost analytic submanifold 
defined by ( = 0. Then T is a conic involutive submanifold ofT*{X) \ {0}, 
and C is (up to almost analytic equivalence) the unique Lagrangian subman- 
ifold of (t*{X) \ {0}) X (t*{X) \ {0}) contained zn T x T and containing 
the wave front H^) ofU. 

Next, is also an elliptic degree zero Fourier integral operator, with 
real phase however. Its associated canonical relation is described in j(7S2j . 
Theorem 6.7, in terms of the moment map \E'. Namely, with u and C{0) as 
in Definition m assume that \E' is transversal to C{0). The conic Lagrangian 
relation 

/^C(T*(X)\{0})x(T*(X)\{0}) 

associated to is then the fibre product Z Xp Z. To discuss the compo- 
sition of n and Q(uj), we shall view the latter as a Fourier integral operator 
with complex phase, whose associated almost complex canonical relation 

D C (t*{X) X {0}) X (t*{X) \ {0}) 

is simply the almost analytic extension of D. In the language and notation 
of almost analytic machinery |MSj . this can be described as follows. 

The moment map : T*{X) — > g* extends almost analytically to \& : 
T*{X) g*, where gc = ®m C. Let C{0) C g* be the complexification of 
C{0) C g*; this can be exphcitly decribed as 
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where O C g* is the coadjoint orbit of 00 in g* under the complexification 
G oi G. Then ^ is transversal to O, and the almost analytic submanifold 
Z = ^f-^{d) C T*(X) \ {0} is the complexification of Z. The fibration 
p : Z ^ Ml extends almost analytically to p : Z — > M^, and the fibre 
product 

D=: Z XpZ C T*{X) X T*{X) 

is the almost analytic extension oi D = Z Z . It is therefore a Lagrangian 
relation in T*{X) x r*(X). 

Clearly, D and E are the sets of real points of D and C, respectively. Set 

A = T*{X) X diag (r*(X)) X T*{X) 

and 

A = T*{X) X diag X T*{X). 

Lemma 11. D x C and A meet transversally in T*{X) x T*{X) x T*(X) x 
T*{X) at every point of (£> x S) n A. 

Proof. All statements in the following arguments are meant to be local along 
the real locus. We have 

D = {(^.,^0 e {t*{X) \ {0}) X {t*{X) \ {0}) : 

^H, ^K) e c{d), p{w) = p{w')} . 

If {w,w') e then the tangent space to D at {w,w') is 

T(u,,w'){D) = ^{v,v') e T^^,u,'){Z X Z) : d^p{v) = (i^'p(w')} • 

With g = dim(G'), set A; = y - dim(O) - 1 = codim(C(e))). If v' e T^'(^), 
the collection of all v e Tyj{Z) with dwp{v) — dw>p{v') is an affine space of 
dimension k. 

Suppose next y — {w, w', w', w") e (L* x E) n A. Then 

(T(^,^o(^) X V.-'OIC")) nT,(A) = : G T(^,^.)(^ x Z), 

C?«;P(^^) = dyj>p{v'), {v\v") e r(^',i„")(C')} 

The condition (Vjv') G T(^^^/)(Z x Z) may be rewritten 



30 



Claim 3.1. C is transversal to C{0) under the map 7 : {w,w') t— > ^{w) 
(along the real locus). 

Proof. Certainly C ^ S ^ S, where 

S = Xap,p, —Xap) : p G X, A G C*| 

is the complexification of S; here a is the complexification of the connection 
1-form a. It suffices to show that E is transversal to C{0) under 7, whence 
that S is transversal to C{0) under the map 7 : {w,w') ^ "^{w). By 
homogeneity of the moment map on the cotangent bundle and equality (A. 11) 
in the Appendix to ICilSlj . if p G X and r > then 

7((p,rap,p, -rap)) = r*((p,ap)) = $(p). 

The statement follows from the hypothesis that $ be transversal to C{0). 

Returning to the proof of Lemma El the Claim clearly implies that 

dime ((T(^,^.)(^) X n Ty{A)^ = dim(C') = 2r, 

where r = 2n + 1 = dim(X). We have on the other hand 

dimc(C') + dimc(lS>) - codimc(A) = 2r + 2r - 2r = 2r, 
and thus the statement. 

Lemma 12. The projection U = (tti, 714) onto the the first and fourth factors , 
U : {w,w',w',w") G (DxS)nAh^ {w,w") G (T*(X) \ {0}) x (T*(X) \ {0}) , 
is injective and proper. 

Proof. Injectivity follows immediately from the description of S. 

Let next K C (T*(X) \ {0}) x (T*(X) \ {0}) be a compact subset. We 
want to establish that Il~^{K) is compact. Now 

(£> X S) n A = {(/i ■ (p, rap), {p, rap), (p, rap), {p, -rap)) : 

7i{p) eW,r>0,hE H^onip)} ■ 

Here Hf denotes the codimension one closed Lie subgroup of the stabilizer 
C G of an element / G 0* discussed on page 349 of |GS2j . The projection 
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K' = q2{K) C T*{X) \ {0} of K onto the second factor is a compact subset 
oiT*{X) \ {0}. Clearly, U-\K) is a closed subset of 

{{h ■ {p,rap), {p,rap), {p,rap), {p, -rap)) : Tc{p) eW,r >0, (45) 

h e H^on{p),{p,-rap) e K'} . (46) 

It thus suffices to show that the latter set is compact. It is obvious that the 
union U7r(p)GTy ^ compact subset of G. Since W is compact, so is 
7i~^{W) C X. Therefore the set of all r > such that (p, —rap) G K' for 
some p G 7i^^{W) is contained in a closed interval [a, 6] C M+. The statement 
follows. 

Remark 3.1. With a view to Corollary |3J we remark that the condition that 
W is compact is not essential in the proof of LemmalT^ In fact, the projection 
K" C M oi K' under the composition T*X — > X ^ M is at any rate a 
compact subset of W, and the condition tt{p) G W may be replaced by the 
condition irlp) G K" in ()45|1 . 

Given this, we can compose the Fourier integral operators Q(^) and 11 |MSj : 

Corollary 5. P(^) is a degree zero elliptic Fourier integral operator with 
complex phase, associated to the almost analytic Lagrangian submanifold 

r= I^DoC'^ G (t*{X) \ {0}) X (t*{X) \ {0}) . 

We now characterize F geometrically. Let T C T*{X) \ {0} be as in the 
statement of Theorem |31 

Lemma 13. Up to almost analytic equivalence, F is uniquely determined by 
the properties: i) T C (t*{X) \ {0}j x (t*{X) \ {0}j is an almost analytic 

Lagrangian submanifold; 

II) F' D DoS^; 

III) F C T X T. 

Proof. It is clear that F' 3 D o I], Let us show that F C T x T. We may 
equivalently show that F' = D o C" C T x T. We have, by definition, 

F' = |(^,^') G (t*{X) \ {0}) X (t*{X) \ {0}) -.^w" e T*{X) 

such that {w,w") G D, {w", w') G . 

Since (7 C T x T, we have w' G T for all {w, w') G F. To show that w G T, 
recall that 

D = Z XpZ C T*{X) X T*{X). 
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It is thus sufficient to show that if w, w" G Z, d{w") = and p{w) = p{w"), 
then d{w) = 0. Being the complexification of the isotropic submanifold Z, Z 
is also isotropic, and the leaf of its null foliation through p G Z is the orbit 
of the complex group Hf C G. Since the action of G preserves the horizontal 
distribution H{X/M) (equivalently, the connection 1-form a), the symbol 
d of the boudary Cauchy-Riemann operator is G- invariant. Complexifying, 
the action of G preserves the horizontal distribution H{X/M), whence the 
components dj of d are G-invariant. Equivalently, since d is G-invariant the 
Hamiltonian vector fields X^^ are in the kernel of dp; their complexifications 
Xj.'s are therefore in the kernel of dp. 

To establish the Lemma, we are thus reduced to proving that if 

Ac (t*(x)\{o}) X (r*(x)\{o}) 

is an almost analytic Lagrangian submanifold such that 

A' D D o S' and A C T X T, 

then (up to almost analytic equivalence) F = A. 

Clearly A' D (D o S'J", where {D o denotes the complexification of 
D o S'. Now {{D o S')')~is a 2(n + l)-dimensional almost analytic isotropic 

submanifold of (t*{X) \ {0}) x (t*{X) \ {0}). On the other hand, T x T 
is the coisotropic submanifold defined by the 2n equations S^'^ = and 

-^(2) 

dj = 0, j = 1, . . . ,n ((1) and (2) stand for the component of evaluation). 
The leaves of the null foliation of T x T are then generated by the flow of 
the Hamiltonian vector fields xj^^^s and X-l^'*'s. These span at each point of 

{{D o S')')~a 2r;,-dimensional linear space which is trasversal to the tangent 
space of {D o S')~. Hence A must be the union of the leaves passing through 
{{D o S')')~. 

We now produce suitable local holomorphic coordinates on M in the 
neighbourhood of p G W, and on L in the neighbourhood of x ^ Z. These 
coordinates are adapted to the fibrating structure of W and Z. 

Lemma 14. For any p eW and any sufficiently small open neighbourhood 
U 3 X in W , the image of U under pw is an open Kdhler manifold S C WK 
The map pu = p\^ : U ^ S is a submersion, and = Pw {^s), where fls 
is the Kdhler structure of S . 

Proof. This is proved by a straightforward adaptation of arguments from 
^GSlj and |(TS2j : we sketch the proof for the reader's convenience and to 
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introduce some notation. As already recalled, by the theory in |GS2j . we 
have the following picture: If p e W and / = G g*, let Hf C G he the 
normal closed Lie subgroup of the stabilizer Gfoif with Lie algebra (jlSI). 
Then the fibre p^{p) is the orbit of p under Hf. Therefore, p'^{p) is 

diffeomorphic to the quotient Hf/H{p), where H{p) C Hf is the stabilizer 
of p in Hf. Furthermore, H{p) C Hf is a discrete subgroup of Hf. Thus, 
TpW is an coisotropic subspace of (TpM,flp), with symplectic complement 
(TpW)^ = Tp{Hf ■ p) C TpW. Let us set Rp =: Tp{Hf ■ p). 

We conclude that pw is a submersion and is a symplectic manifold of 
real dimension 2 (n — dim(ifj-)) = 2{n — g + dim((9) + 1). Furthermore, for 
j9 G M let Fp C TpM ® C be the +i-eigenspace of the complex structure 
Jp e End (TpM). By Lemma 3.6 of [UHil, 

Fp n {Rp ® C) = 0. (47) 

For p G W, we set 

F; =: Fp n (TpW ® C) ; 

then (Fp)-*- has complex dimension n + dimHf {n is the complex dimension of 
M). Therefore, by if/-invariance and dimension count, F' descends to a well- 
defined positive Lagrangian complex distribution on 5*. Integrability follows 
as in loc. cit., and therefore S inherits compatible complex and symplectic 
structures. 

Lemma 15. Pick any p & W and let U be any sufficiently small open neigh- 
bourhood of p in W . Set S = Pw{U), and endow it with the holomorphic 
structure described in Lemma^^ Then there exists a map a : S W sati- 
sfying the following properties: i) (T {pw{p)) = p; ii): a is holomorphic as a 
map from S to M; Hi): a is a section of pw, that is, pw o cr = ids- 
Proof. The only property not immediately obvious is (ii). Set as above 
k = g — dim((9) — 1; we may choose local coordinates ti, . . . ,tg for q* on a 
neighbourhood V of f = ^{p) centered at / and such that C{0)nV is defined 
by ti = ■ ■ ■ = tfc = 0. Let U C $~^(V) be a sufficiently small neighbourhood 
of p. The map 

^■.U^R^p'eU^ (ti($(p)), • • • , 4($(p)) G 

is a submersion, and its image a neighbourhood of G M'^. For c & U, let 
Wc = ip~^{c) C U. Then Wq = W nU, and Wc is a submanifold of U for 
every c E D. If g G f/, define 

F^'=:F,n(T,(iy^(,))®C). 
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Let us set Rg =: Tg{W^(g-))-^. Given (jlTj) . we have 

Fg n ® C) = (48) 

for every q E U (perhaps after further restricting U). This imphes that F' is a 
complex distribution on U, of rank n — g + dim{0) + 1. It is integrable, essen- 
tially by definition, and therefore the complex version of the Frobenius inte- 
grability theorem applies. Thus, we may find local holomorphic coordinates 
ri, . . . , r„ on U centered at p, such that F' = span {d/drj : j = 1, . . . , k}. 
After further restricting if necessary, the manifold S = {r,fc_|_i = ■ ■ ■ = r„ = 0} 
is then a section of p, as required. 

The G-invariance of L and V clearly implies 
Lemma 16. LetU C Z and S = p{U) C M« he as in Lemma\T^ On S there 



are an hermitian line bundle [Ls,hi^^ with (unique) compatible connection 
Vls, such that = Pu{Ls), = vhihi) and Vl = Pu C^Ls)- 

We have in fact Ls = a*{L), hig = o"*(/'-l), Vls = cr* (Vls)- 

Let us now fix p E W and let U be the open neighbourhood of p in W, 
S the open Kahler manifold and ttu = pw\u '■ U ^ S he the submersion 
described in Lemma ^3 Let a : S U M he the holomorphic section 
described in Lemma ITHl Set p = T^uip) ^ and let (zi,...,Zfc) be local 
holomorphic coordinates on 5* centered at p, where k = n — g + dim (9 + 1. 
Let Hj C G be the complexification of Hf, with Lie algebra f)j = [)j C?) C. 
Let exp : f)^ — > Hj- he the exponential map of Hj, and let V G he an 
open neighbourhood of the origin such that exp induces a diffeomorphism of 
V onto its image. Then, perhaps retricting S and V to smaller open subsets, 
the holomorphic map ( : S x V M given by 

C : is,v) exp{v) ■ a{s) 

is a diffeomorphism onto its image. We obtain local holomorphic coordinates 
{zi, . . . , Zk, Wi, . . . , Wh) on M centered at x; here Wj = Uj + ivj, where Uj and 
Vj are linear coordinates on and h = n — k = g — dim O — 1. 

We may also suppose without loss of generality that the local holomorphic 
coordinates {z,w) are preferred at p in the sense of |SZj : in our integrable 
case this simply means that in the given coordinate system the Kahler form 
at p is the standard symplectic structure Uq on C^. To see this, notice that 
we have a symplectically orthogonal direct sum 

Tp{M) 0C = F'®[Rp® JpiRp)] , 
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where Rp = Tp{Hf ■ p). Furthermore, Rp and Jp{Rp) are dually paired La- 
grangian subspaces of the symplectic subspace Rp © Jp{Rp). In terms of the 
decomposition 

To(S X V) = © f)^ and = (^^ © i ■ ()^ 

we have 

f; = do( © {0}) , Rp = doC ({0} (Bhf® m , 

Jp{Rp) = doCm®{0}®^■i)f). 

Thus, in order for {z, w) to be a preferred system of local holomorphic co- 
ordinates at p it is sufficient to choose the Zi^s so that they form a system 
of preferred coordinates on S at p, and to make an appropriate choice for a 
basis in 1)/. 

Let now be a preferred holomorphic local frame for L at p in the 
sense of |SZj . Given our choice of a preferred system of local holomorphic 
coordinates {z,w) at p, the function /5 = ||e^|p = ||e2,||~^ then satisifes 

p{z,w) = l + \z\'^ + \w\'^ + --- . (49) 

A point in the neighbourhood of L*{p) C L* with local holomorphic coordi- 
nates {z, w, A) lies on X if and only if \X\'^P{z,w) = 1. 

In order to obtain an asymtpotic expansion for the equivariant Szego 
kernels P^j on the diagonal, we shall need a more complete description of 
their microfocal structure near any given point of diag(W^). To this end, we 
shall now prove the existence of a regular positive phase function, in the sense 
of |MSj ■ microlocally associated to the Lagrangian almost analytic manifold 
r in the neighbourhood of any point in {p,p) G diag(iy). The phase function 
will be (locally) defined on X x X x ]R+ and have the form t ■ ipuj{x, y)- 

Let us then fix po ^ and adopt in an open neighbourhood T of Pq in M 
the local holomorphic coordinates (z, w) introduced above. This determines 
local holomorphic coordinates (z, z' , w') on the open neighbourhood T x 
T C M X M of {po,Po) € diag(iy). Let us choose on T (perhaps after 
restriction) a preferred holomorphic local frame for L at po. 

Recall that M and X denote the almost analytic extensions of M and X, 
and that the S'^-principal bundle ir : X ^ M almost analytically extends to 
a C*-bundle tt : X ^ M. 

Proposition 2. Let po G W and T be as above. Then, perhaps after restrict- 
ing T to a smaller open neighbourhood of Pq, there exists a smooth function 
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b G C°°{T X T) with the following property: Let ip G C°°(X|^ x X\j) he the 
restriction of ^ G C°°{L\j, x L\j,) given by: 

i,ii,n=t-{l-\fxb{p,q)), 

where i, i' G L|y correspond to {p,\), {q, jj) G T x C, respectively. Then 
t ■ ip & C°° {X\j, X X\j, X M+) is a regular phase function for T. 



This means the following |MSj . |SZj . Let t/' be the almost analytic exten- 



sion of 'i/' to X 



X X 

f 



. Then 

f 



[x, tds:ip,y,tdyilj) : ip{x,y) = 0, t G IR+ L (50) 



In addition, we shall prove in Proposition IHl that is of positive type, that 
is, the imaginary part of ip satisfies T{tp) > 0. 

Proof of Proposition [B We shall adapt the reduction argument in the proof 
of Theorem 2.1 of jSZj to the present equivariant context. 

As a first step, we shall replace the holomorphic preferred local section 
cl of L at p with a different local section, cl, not holomorphic but capturing 
the equivariant geometry of our picture. We shall construct a phase function 
for r of the asserted form = i (1 — Xjlc{p, q)) in the local (nonholomorphic) 
coordinates on L* (and X) associated to the holomorphic coordinates {z, w) 
on M and the section e^. The phase function in the original holomorphic 
coordinates will then be given by pull-back under the change of basis from 
6*1^ to e^. Going back to holomorphic coordinates will be convenient in the 
proof of Proposition El 

To this end, in the notation of Lemmas El and ^3 let us first of all 
choose a local holomorphic section cl^ of the Hermitian holomorphic line 
bundle Ls = a* (L) on S which is preferred at pq. We shall view this as a 
section of L defined on the submanifold cr{S) C M. 

Next we shall extend e^.^ to a local section of L by using the action of 
the complexified groups Hf. More precisely, set 



H = ^^{h, s) e G X S : he H^(ais)) 



n= {ih,s) eGx S : /iG 

Then Ti Q 7i and the projection onto the second factor induces smooth 
fibrations f : — > S' and r : H ^ S with r~^(s) = i^<i.{o-(s)) and f~^(s) = 
H^a{s)) for every s E S. There is an obvious smooth map 

A-.n — > M, {h,s)^h-(r{s) 
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which is a local diffeomorphism along the unit section S = {{e, s) : s E S} of 
r. Therefore, A induces a diffeomorphism of an open neighbourhood U of S 
onto an open neighbourhood T of (j{S) in M. Let U = U r\7i. Then U maps 
diffeomorphically under A onto an open neighbourhood T' = T (1 W of (7(3) 
in W. 

A is covered by the smooth map 

B-.n — >L, {h, s) ^ h ■ cls icr{s)) . 

Setting cl {A{h, s)) = B{h, s) {{h, s) E H) we thus define a C°° section of L 
over T. 

Let be the dual frame of L* over T, and set /3 = ||e2g|| = pLgH"^. 
Since G preserves the Hermitian structure of L, j3 is constant along the fibres 
of pw '■ W — >■ in T. Then /3~^/^e^g is a unitary section of L* over T, and 
induces a trivialization x : S"^ x T = 



x(A,p) = I p, ^ — elsi.P) 

'm 

Suppose that p' E T has local coordinates (z, a + iO) (a E M). Pick 
x' G T^~^{p') with coordinates (z,a, A). If /i G H^(^p/^ and h ■ p' E T, then 
h ■ p' E T and it has coordinates (z, 6, A) for some 6 G M. 

Now, in view of Lemma El and (jl^ ip will parametrize F if the following 
conditions are satisfied: 

i) set Z^ip) = {{x,y) E X\j, x X\rp : ip{x,y) = 0}; then 

Z{^) = {{x,h ■ x) E X\j, X X|y : 7r{x) EW,h E i/$(,r(2^^)) } ; 

ii) : da:^p\z^^) = gi(a), - = 92(«)> where : X x X -> X is the 
projection onto the i-th factor; 

iii) : passing to almost analytic extensions (and writing X for X ), set 

f 



Z{i/j) = ^{x,y) E X X X : ^/j{x,y) = 0|; then C (^i, 4^ j = 0, C [V^dyip^ 

on Z{iIj); here ( is the symbol of boundary (9-operator on X, C is the almost 
analytic extension of ( (and, as in Theorem |3] and Lemma El is defined 

byC = 0). 

We look for a solution of the form = i (1 — A/ic(p, g)), and view i), ii) 
and iii) as conditions on c. To determine c, we shall symplectically reduce F 
with respect to the S'^-simmetry. 

Namely, the action of 5*^ on X lifts to a Hamiltonian action on T*(X) \ 
{0}. Let u : T*X \ {0} ^ M be the moment map. These actions in turn 
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almost analytically extend to actions of C* on X and T*{X), and u to an 
almost analytic map u : T*{X) \ {0} C. The symplectic reductions of 

(t*(X) \ {0}) X (t*{X) \ {0}) and (T*(X) \ {0}) x (T*(X) \ {0}), given 

by 

(z> X i))-^ (1, 1)/C* xC* D {ux 1)/S^ X 

are symplectically equivalent to T*{M x M) \ {0} and T*(M x M) \ {0}, 
respectively. The 5*^- and C*-invariant functions ( and ( descend to functions 
Cr- and Cr on T*(M x M) \ {0} and T*(M x M) \ {0}, and (r is the almost 
analytic extension of (r- The reduced Lagrangian submanifold T,. C T*{M x 
M) \ {0} is defined as 

r, =: (r n (z> X vY\i, i)) /c* x c*. 

Let C T*(M) \ {0} be the reduction of T, that is, the almost analytic 
submanifold defined by = 0. Given Lemma F,. may be charachter- 
ized geometrically as the unique almost analytic Lagrangian submanifold of 
T*{M X M) \ {0} contained in x and with the given real locus, which 
is the reduction of the real locus of F. 

The pull-back of 4> under x x % is the function 

0' = z(l-A7l7(p,g)) 



on X X X, where ^{p, q) = c{p, q)/ y P{p)y P{q)- Hence we may view i), ii) 
and iii) as conditions on 7. 

Over diag(iy) CMxMCMxMthe projection F^ ^ M x M is a local 
diffeomorphism. Therefore we can find, locally along diag(iy), a function 
7(p, q) such that 

Tr = I (p, dp log(6), q, -dq log(6) j : p, g G Af | . 

The real locus {Tr)m. of F^ is the reduction under x of the real locus of 
F; given Lemma ITUl and in local coordinates we have 

(r.)R = {((p, O.h- (p, -0) : p G ly, C G T;(M), 3 such that 

a(2,e«) = d9 + C,he if$(p) } . (51) 

Lemma 17. If x E X , p = it{x) G W and hg G i/$(p) is a smooth path, the 
path q{s) = kg ■ X in X is horizontal. 
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Proof. It suffices to show that if p = tc{x) G W and G f)/, where / = 
then the induced vector field on X is horizontal at x, that is, 
o^x i^xix)) = 0. In view of (fT9|) . we are then reduced to proving that if 
^ G f)/ then (j)^{p) = 0. We have 

in view of (jlHjl . 

Lemma 18. 7 zs constant on W Xp^W . Therefore, after adding a suitable 
additive constant to it, we may assume that 'y = 1 on W W , i.e. that 
<?) = \/ fi{p)\J (3{q) ifpEW and q = h ■ p with h G H^(^py 

Proof. Let {pi, hi -pi) G W Xp^ W be in the neighbourhood of {po,Po). Thus, 
Pi E W and hi G Hq,(^p^y We can join (poiPo) and (pi, hi-pi) within W Xp^W 
going first from (po;Po) to through a smooth path = {pt,Pt) 

(t G [0, 1]) with Pi G for every t G [0, 1], and then from to (pi, hi-pi) 

through a path z/(t) = (pi, /i^ ■ pi) (t G [0, 1]) with ho = e and /i* G for 
every t G [0, 1]. It is thus sufficient to show that b is constant on every path 
of the above form, and for this in turn it suffices to check that every element 
of (Tr)R vanishes on the tangent vectors to these paths. 

An element of (Tr)^ lying over {pt,Pt) has the form rj = {pt, C,Pt, —() for 
a suitable cotangent vector ( at pt, while = iPt,Pt)- Thus, (r^, {pt,Pt)) = 

apt) - apt) = 0. 

An element of {Tr)^ lying over {pi, hg ■ Pi) has the form 

V = {Pi,ahs-pi,-Cs) 

where (s = (c^pi^^^)* (0- Here by definition ( G Tp^M satisfies a(pj eifl) = 
C + dO, and dp^h~^ denotes the differential of /i^^ £ C, viewed as a diffeo- 
morphism of M, at pi. 

On the other hand, ^[^^^ = (0, where k{s) = hs ■ pi. Thus, we 

need to check that {i^{s)) = for every s. 

Let us consider, in the local trivialization induced by e^, the path in X 
given for some fixed 6* G M by 

~k{s) = hs-{pi,e'') = iK-pi,e'') 

(the second equality refiects the construction of e^). 

By Lemma fT7| k is horizontal, that is, 0^(5) (^(-s)) = for every s. Since, 
again invoking the definition of (rr)^. and the construction of e^, ^^(s) = 
Cs + d9, we conclude that (g (i^is)) = 0. 
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Let now F' C T* yX x Xj \ {0} be the almost analytic Lagrangian sub- 
manifold parametrized by (f)'. By constructon, T' satisfies conditions (ii) and 
(iii) above. To verify condition (i), suppose that {xo,yo) G Z{(f)') and thus 
{xo,dx(f)'{xo,yo),yo, -dy(j)'{xo,yo)) G T'^ (the real locus of T'). Then (in view 
of |SZj . (44)) d\og{'y){xo,yo) must be real. Thus, if Xo,yo G X correspond 
to ((po, Ao), (qo, /^o)) under x x X; we must have {pq, go) G W W. Hence 
liPoy Qo) = 1) and the condition that 4>'{po, qo) = 1 implies Aq = /io- Thus, by 
our choice of local coordinates, if h E Hq,(^p^) is such that qo = h -po, we have 
yo = h- xq. Hence, T' satisfies (i) and the proof of Proposition |21 is complete. 

Proposition 3. The regular phase function of Proposition is of positive 
type, that is, the imaginary part of ip satisfies 

X{i)) > (52) 

on an open neighbourhood of {po,Po) G W W . 

Proof. Let us go back to our original preferred holomorphic coordinates in the 
neighbourhood of Pq. Recall the geometric charachterization of F described 
in Lemma IT^ The condition that F C T x T fLemma ll31 iii)) implies 

Claim 3.2. To infinite order along W Xp^ W, a is holomorphic in p and 
anti-holomorphic in q. 

On the other hand, the condition that F D (D o S')' be the real locus of 
ip (Lemma I13| ii)) forces (in the given trivialization) 

l = XjIa{p,q) ((p. A), (g,/i)) G D o S'. 

In particular, applying this to ((p. A), (p. A)) G diag(X) with p G W, we 
obtain 

a{p,p) = (3{p) (peW). 

In other words, a(-, ■) restricted to diag(iy) is the dual hermitian metric /? 
on L*, in the holomorphic coframe e^. 

In the local holomorphic coordinates {zi,Wj), with Wj = aj + ibj, W is 
defined by the equations bj = 0. Thus, working in local coordinates near 

p eW and given (gHl), a{{z,a + iO), (z, a + iO)) = 1 + |zp + |ap H . In 

view of Claim IT^ we conclude 

Corollary 6. To infinite order along W , 

a {{z, w), {z', w')) = l + z-z' + w-w'+-- - . 
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We can now apply verbatim the argument following the proof of Lemma 
2.2 in SZj (we only need to replace z with the pair {z,w)) to conclude that 
ip is a. positive phase function. More precisely, let us fix xq G n^^{po). We 
may assume that e2(po) = xq, so that xq has local coordinates {zo,Wo,Oq) = 
(0, 0, 0), where A = e*^). A nearby x E X has local coordinates {z, w, 6). Let 
us compute X{%Ij{xq,x)) as the real part of —iip{xQ^x). We obtain 

. , , , , a(0, 0, z, w) , ,Yix 

-i^{xq,x) = 1 - e = (1 - e ) 

^J(5{z,w) 



+e" 



1 



P + 0(||(z,u;)f) 



2 

which is positive if Q and (z, w) are small. 
Given this, we may conclude: 

Proposition 4. P(^) may 6e microlocally represented near the diagonal by 
an oscillatory integral of the kind: 

oo 

^ity,^{x,y) s^^^^y^t)dt, 

where G S'"(X x X x M+) has an asymptotic development 

oo 

s^{x,y,t)^Y.^--^'\i\x,y). 

By ellipticity s''^\x,y) ^ if {x,y) G T^. 

With this microlocal description, to complete the proof of Theorem El we 
need now only follow the argument in the proof of Thoerem 1 on pp 327-9 

aim- 

Corollaries n and El are now straightforward, since the complexification G 
of G acts on each irreducible piece H^{M, 



Let us now remove the simplifying assumption that u) lie in an elementary 
fundamental wedge for the Hamiltonian action of G on T*X. Recall that 
: T*X g* is the moment map. 

Lemma 19. Let R C T*X \ {0} be a G-invariant open conic set satisfying 
the following conditions: 

i): the restriction ^\p^: R ^ q* is trasversal to C{0); 
a): Guj acts freely on "^^^^lj) fl R. 
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Then Zji = \1/~^(C((9)) H R is a fibrating coisotropic suhmanifold of R, 
and the leaf of the null fihration through y E Zji is the orbit of Hf, f = 
Let Pzr '■ Zji he the null fihration. Then the fihre product Zfj Xp^^ Zji C 

T*X X T*X is a Lagrangian relation. Furthermore, the orthogonal projector 
Q(^u)) '■ L'^{X) if(X)(t^) is microlocally equivalent on R x R (1 T*X x T*X 
to a Fourier integral operator associated to Zr ^pz-^ Zr. 

In other words, there is a Fourier integral operator Q(a;) on X associated 
to the Lagrangian relation Zr Xpz^ Zr such that 

WF (Q(^) - g(^)) n (i? X i?) = 0. 

Proof. This follows straightforwardly from the theory of |GS2j . but we shall 
sketch a proof for the reader's convenience. 

The first part of the Lemma is an immediate consequence of the argu- 
ments in section 2 of loc. cit.. 

On the other hand, 

r = {(^?, 7, C, ^70 : ^7 G G, C G T* X \ {0}, 7 = ^(C)} (53) 

is a canonical relation in T*G x T*X x (T*X)" (cfr (4.2) of loc. cit.), called 
the moment Lagrangian for the action of G on T*X. In our case, this is 
simply the co normal bundle to the graph of the action of G on X. Here 
we implicitly identify T*G with G x by means of right translations, and 
denote by {T*X)~ the symplectic manifold obtained by T*X by changing 
sign to the standard symplectic structure. Restricting to R x R, we obtain 
a homogeneous canonical relation 

TR = {{g,j,C,90 ■■ g E G, C e R, ^ = <iliC)} ^T*G X Rx R-. (54) 

Let furthermore 

Ac(o) = {i9J)--fe G{0),g eHfjCGxg*^ T*G 

be the charachter Lagrangian associated to G{0), a homogeneous Lagrangian 
submanifold of T*G. Under the hypothesis of the Lemma, and Ac(o) 
intersect cleanly, and Zr >^pz^ ^i? = ° ^0(0)- 
Now recall that 

= / XHi9~^)Qi9)dg, 
Jg 

where by g we denote the unitary action of G on L^(X), and 

= J^dim(Vfc<^)xfc<^- 
fe=i 
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Here Xkuj is the charachter function associated to the irreducible representa- 
tion with highest weight kiv. By Theorem 6.3 of |GS2j . X{uj) is a Lagrangian 
distribution on G, associated to the charachter Lagrangian Ac{o)', on the 
other hand, the Schwartz kernel g G V {G x X x X) of the action ^ is a 
Lagrangian distribution on T*G x T*X x (T*X)~, associated to the moment 
Lagrangian. By the above, the Schwartz kernel G V{X x X) of Q(^) is 
given by: 

Jg 

Let Pi + P2 ~ id be a pseudodifferential partition of unity on X such that 
Pi ~ id on R. We may write g = Qi + §2, where gj = Pj o ^, and accordingly 
Q{u}) ~ Q{u}),i + Q(uj),2- Then Q(<^),2 is smoothing on Rx R. Since on the other 
hand ^1 is a Lagrangian distribution associated to Fr, by the hypothesis we 
may interpret Q{uj),i as a pull-back (under the diagonal map G x X x X ^ 
G X G X X X X), followed by a push-forward. The Lemma then follows from 
the usual functorial properties of distributions. 

Let us now return to the proof of the Theorem. Given the relation between 
\Ef and $ on the cone Y C T*{X), if $ is transversal to C{0) then at 
any rate so is ^E'|y, whence \1/ itself in a conic open neighbourhood R of 
Y in T*X \ {0}. Given the G-equivariance of \Ef, we may assume that R 
is G-invariant. By assumption, G^ acts freely on (M+cu), whence on 
\E'^^ (]R_i_c<j)ny. Therefore, perhaps after replacing i? by a smaller G-invariant 
conic open neighbourhood of Y in T*X \ {0}, we may assume that Gf acts 
freely on \E'~^ (R+a;)nP. Arguing as above with a pseudodifferential partition 
of unity, we may decompose Qi^^) (or Q'^^-,) as a sum Q(t^) = Q{uj),i + Q{io),2, 
where Q{uj),2 is smoothing on RxR. Therefore, so is the composition Q(^) 2on, 
since WF(n) OYxYORxR. Every choice in the above argument may 
be assumed S'^-invariant. We are thus reducing to applying the previous 
arguments to the composition Q{uj),i o H. 

4 Proof of Proposition H 

The proof is a slight modification of some of the arguments in the proofs of 
Theorem 1 and of Theorem |21 Fix p G M with $(p) 7^ 0, and for e > let 

Up,e =: {g eG : distM{gp,p) < e}. 

Then f/p is an open neighbourhood of the stabilizer subgroup 

Gp = {g eG : gp = p}, 
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and Up^^ — > Gp as e ^ 0. We have Gp = {e} if p ^ R, since in our situation 
G acts freely on M \ R = G ■ <^~\0). 

Choose X E X with p = 7r(x). Then Ilk^uj{p,p) = ^k,uj{x,x) may be 
decomposed as in (fTI)|) with U = Up/, thus the first term is the integral of an 
averaged Szego kernel over Up^^ and the second is the integral over G \ Up^e- 
For any fixed e, the latter term is therefore rapidly decreasing as k +00, 
since Ilk{x',x") is rapidly decreasing in k if n{x') 7^ 7i{x"). We are then led 
to estimate 

Ilk,^{x,xy =: dim{V^) ■ Xa{g~^)^k{P'g-^{x),x) dg, (55) 

and we shall now argue that if e has been chosen suitably small (in particular, 
very small with respect to (f{p) = ||$(p)|| > 0) then Uk^^ix, x)' is also rapidly 
decreasing as A; ^ +00. To this end, let us first remark that, as in (fTTj) . 
^k,uj{x,x)' may be written as a complex oscillatory integral in dg, d6, du, 
with phase 'i/x{g,(^,u) = wip{e'^^fig^i{x),x) — 9 (here and below we think of 
X as a parameter, and denote by d'^x the differential of with respect to 

Arguing as in the first part of the proof of Lemma El we can see that 
given < a < 1 < 6 there exists d > and e' > such that if < e < e' then 
Wd'^xig, > d if g E Up^^ and u ^ [a, b]. 

Now if g & Up^^ we have an estimate similar to ()35|) . with eg replaced 
by e, and to (jSZ|), with C2eo replaced by ip{p). Therefore, if e has been 
chosen sufficiently small, the phase "^x has no stationary points on Ux,e x 

X (0, +00), and actually its differential is bounded from below in norm 
there. This proves the first statement of the proposition. 

Now let K G M \ ($~^(0) U R) be a compact subset, and let us show 
that the rapid decay of Ilk,uj{x, x)' is uniform over x G t:~^{K). For 5 > let 
f/5 C G be the 5-neighbourhood of the identity in G, with respect to some 
fixed invariant metric. As K is compact and G acts freely on the semistable 
locus G ■ $^^(0) D there exist < r^^s < sk,5 such that 

distx(5'a;, x) < sk,s for any x E X and g G Us, (56) 

distx(5'a;, x) > r^^s if tt{x) G K and g Us- (57) 

Furthermore, we may assume that rK,s < sk,s ^ as 5 ^ 0. 

Let us then choose 5 > so that sk,5 is very small with respect to 

ip{K) =: min{ip{p) : p G K} > 0. 
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For every x G n^^lK) we may decompose Ilk^uj{x,x) in p6|) . where the first 
term is now the integral over Us and the second is the integral over G\Us. 
In view of ()57|1 . the latter term is rapidly decreasing in k as k +00. 
We are thus led to look for a uniform estimate, over x G 7i^^{K), of 

Ilk^u{x,x)' =: dim{V^) ■ Xa{9'^)^k{fj'g-^{x),x) dg. (58) 

J Us 

Viewing this as a complex oscillatory integral as in (fTTj) . we want to bound 
from below the differential of the phase "^xig, u) = uip{e^^ fig-i{x), x) — 6, 
uniformly over x G n~^{K). 

Given that 7r~^(if) is compact, a slight modification of the argument used 
in the proof of Lemma El now proves the following: IfO<a<l<6 and 
< c < TT there exists 7 > such that for all sufficiently small 5 > we have 
Wd'^xW > 7 if X G 7r~^(_ft'), g e Us and u ^ [a, b] or 9 ^ [-c, c]. 

We may now argue as in the first part of the proof of this Proposition, 
however replacing now with sk,5 in the analogue of (j35|) . holding if {x, g) G 
K X Usi and 6*260 with '{){K) in the analogue of (jHIj). 
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